ar X iv : c m p - lg / 9 61 20 03 v 1 1 7 D ec 1 99 6 Metrics for evaluating dialogue strategies in a spoken language system
نویسنده
چکیده
In this paper, we describe a set of metrics for the evaluation of different dialogue management strategies in an implemented real-time spoken language system. The set of metrics we propose tries to offer useful insights in evaluating how particular choices in the dialogue management can affect the overall quality of the man-machine dialogue. The evaluation makes use of established metrics: the transaction success, the contextual appropriateness of system answers, the calculation of normal and correction turns in a dialogue. We also define a new metric, the implicit recovery, which allows to measure the ability of a dialogue manager to deal with errors by different levels of analysis. We report evaluation data from several experiments, and we compare two different approaches to dialogue repair strategies using the set of metrics we
منابع مشابه
ar X iv : q - a lg / 9 61 20 14 v 1 1 1 D ec 1 99 6 Integral soluitons of q - difference equations
Two integral solutions of q-difference equations of the hypergeometric type with |q| = 1 are constructed by using the double sine function. One is an integral of the Barnes type and the other is of the Euler type.
متن کاملar X iv : c m p - lg / 9 71 10 07 v 1 1 9 N ov 1 99 7 LANGUAGE MODELLING FOR TASK - ORIENTED DOMAINS
This paper is focused on the language modelling for task-oriented domains and presents an accurate analysis of the utterances acquired by the Dialogos spoken dialogue system. Dialogos allows access to the Italian Railways timetable by using the telephone over the public network. The language modelling aspects of specificity and behaviour to rare events are studied. A technique for getting a lan...
متن کاملar X iv : q - a lg / 9 61 20 03 v 1 1 D ec 1 99 6 Non – Symmetric Jack Polynomials and Integral Kernels
We investigate some properties of non-symmetric Jack, Hermite and Laguerre polynomials which occur as the polynomial part of the eigenfunctions for certain Calogero-Sutherland models with exchange terms. For the non-symmetric Jack polynomials, the constant term normalization N η is evaluated using recurrence relations, and N η is related to the norm for the non-symmetric analogue of the power-s...
متن کاملar X iv : d g - ga / 9 71 20 03 v 1 2 D ec 1 99 7 The Positive Fundamental Group of Sp ( 2 ) and Sp ( 4 )
In this paper, we examine the homotopy classes of positive loops in Sp(2) and Sp(4). We show that two positive loops are homotopic if and only if they are homotopic through positive loops.
متن کامل